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ARRANGEMENT IN A LOCAL COMPUTER FOR SENDING VOICE MESSAGES TO A 



FIELD OF THE INVENTION 

The present invention relates to a browser-based arrangement for recording and sending voice 
messages to a unified messaging system for storage in a unified message store. 

DESCRIPTION OF THE RELATED ART 

The evolution of the public switched telephone network has resulted in a variety of voice 
applications and services that can be provided to individual subscribers and business subscribers. 
Such services include voice messaging systems that enable landline or wireless subscribers to record, 
playback, and forward voice mail messages. However, the ability to provide enhanced services to 
subscribers of the public switched telephone network is directly affected by the limitations of the 
public switched telephone network. In particular, the public switched telephone network operates 
according to a protocol that is specifically designed for the transport of voice signals; hence any 
modifications necessary to provide enhanced services can only be done by switch vendors that have 
sufficient know-how of the existing public switched telephone network infrastructure. 

An open standards-based Internet protocol (IP) network, such as the World Wide Web, the 
Internet, or a corporate intranet, provides client-server type application services for clients by 
enabling the clients to request application services from remote servers using standardized protocols, 
for example hypertext transport protocol (HTTP). The web server application environment can 
include web server software, such as Apache, implemented on a computer system attached to the IP 
network. Web-based applications are composed of HTML pages, logic, and database functions. 
In addition, the web server may provide logging and monitoring capabilities. 

In contrast to the public switched telephone network, the open standards-based IP network 
has enabled the proliferation of web based applications written by web application developers using 
ever increasing web development tools. Hence, the ever increasing popularity of web applications 
and web development tools provides substantial resources for ^plication developers to develop 
robust web applications in a relatively short time and an economical manner. However, one 



UNIFIED COMMUNICATIONS SYSTEM 



BACKGROUND OF THE INVENTION 



95-454 



WGM 3480 




important distinction between telephony-based applications and web-based applications is that 
telephony-based applications are state aware, whereas web-based applications are stateless. 

In particular, telephony applications are state aware to ensure that prescribed operations 
between the telephony application servers and the user telephony devices occur in a prescribed 
5 sequence. For example, operations such as call processing operations, voicemail operations, call 
forwarding, etc., require that specific actions occur in a specific sequence to enable the multiple 
components of the public switched telephone network to complete the prescribed operations. 

The web-based applications running in the IP network, however, are state-less and transient 
in nature, and do not maintain application state because application state requires an interactive 
10 communication between the browser and back-end database servers accessed by the browsers via 
a HTTP -based web server. However, an HTTP server provides asynchronous execution of HTML 
~ applications, where the web applications in response to reception of a specific request in the form 

" : \ of a URL from a client, instantiate a program configured for execution of the specific request, send 
an HTML web page back to the client, and terminate the program instance that executed the specific 
fi5 request. Storage of application state information in the form of a "cookie" is not practical because 
^ 1 some users prefer not to enable cookies on their browser, and because the passing of a large amount 

q of state information as would normally be required for voice-type applications between the browser 

f '] and the web application would substantially reduce the bandwidth available for the client. 

O Commonly-assigned, copending application serial number 09/480,485, filed January 11, 

l : 20 2000, entitled Application Server Configured for Dynamically Generating Web Pages for Voice 
Enabled Web Applications (Attorney Docket 95-409), the disclosure of which is incorporated in its 
entirety herein by reference, discloses an application server that executes a voice-enabled web 
application by runtime execution of extensible markup language (XML) documents that define the 
voice-enabled web application to be executed. The application server includes a runtime 
25 environment that establishes an efficient, high-speed connection to a web server. The application 
server, in response to receiving a user request from a user, accesses a selected XML page that 
defines at least a part of the voice application to be executed for the user. The XML page may 
describe any one of a user interface such as dynamic generation of a menu of options or a prompt 
for a password, an application logic operation, or a function capability such as generating a function 
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call to an external resource. The application server then parses the XML page, and executes the 
operation described by the XML page, for example dynamically generating an HTML page having 
voice application control content, or fetching another XML page to continue application processing. 
In addition, the application server may access an XML page that stores application state information, 
enabling the application server to be state-aware relative to the user interaction. Hence, the XML 
page, which can be written using a conventional editor or word processor, defines the application 
to be executed by the application server within the runtime environment, enabling voice enabled web 
applications to be generated and executed without the necessity of programming language 
environments. 

Hence, web programmers can write voice-enabled web applications, using the teachings of 
the above-incorporated application serial number 09/480,485, by writing XML pages that specify 
respective voice application operations to be performed. The XML documents have a distinct 
feature of having tags that allow a web browser (or other software) to identify information as being 
a specific kind or type of information. Hence, the XML documents define the application to be 
executed by the application server within the runtime environment, enabling voice enabled web 
applications to be generated and executed without the necessity of programming language 
environments. 

Commonly-assigned, copending application No. 09/459,926, filed December 14, 1999, 
entitled Apparatus and Method for Providing Browser Audio Control for Voice Enabled Web 
Applications (attorney docket 95-406), the disclosure of which is incorporated in its entirety herein 
by reference, describes a browser based arrangement for selectively executing audio operations 
specified by XML elements within a received HTML page, generated by the above-described 
application server. In particular, the application server generates the HTML page with XML tags 
that specify voice application control content; if the web browser does not have the necessary 
executable audio resource to execute the audio operations specified by the XML elements, the web 
browser ignores the XML elements and merely presents any other recognized HTML tags to the 
user. However if the web browser has access to an executable audio resource that understands the 
XML element, then the web browser executes the audio operation based on enhanced audio control 
specified by the XML element. Hence, a web browser can be used to provide enhanced control for 
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voice enabled web applications generated by a server, merely by possession of an executable audio 
resource that recognizes the XML element that specifies the enhanced audio control required for the 
audio operation to be performed (e.g., record, post recorded message, playback). 

The above-described arrangement for providing a web-based voice application, such as a 
5 voice messaging application, still assumes an interactive session in the form of HTTP requests and 
responses between the browser (which may be implemented as a proxy browser resident on an IP 
telephone) and the application server. Hence, if a user attempted to send a voice message without 
relying on the interactive session with the application server, for example by sending a MIME 
encoded .wav file by SMTP, the message would be stored as an e-mail message having a .wav 
1 0 attachment instead of a voice message recognizable by the unified communication system. Hence, 
a user such as a mobile user having a portable PC cannot leave a voice message for a unified 
messaging subscriber without interacting with a unified messaging server. 

£ :-•> 

• ■x ta 

M 5 SUMMARY OF THE INVENTION 

~ n There is a need for an arrangement that enables a user to create a voice message for a unified 

I s " messaging subscriber without relying on an interactive messaging session with a unified messaging 

r;f server. 

!; £0 There also is a need for arrangement that enables a user to record a voice message using a 

PC, and to store the recorded voice message in a voice message box of a unified messaging 
subscriber, without relying on an interactive messaging session with a unified messaging server. 

There is also a need for an arrangement that enables a user to locally record a voice message 
for a unified messaging subscriber, and forward the voice message for retrieval by the unified 
25 messaging subscriber, without the necessity of the user accessing a unified messaging server for 
generation or transfer of the voice message. 

These and other needs are attained by the present invention, where a user computer, for 
example a personal computer (PC), includes a recorder configured for generating an audio file 
having an identifier enabling a unified messaging system to identify the audio file as a voice 
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message, and an e-mail client configured for sending the audio file to a prescribed destination 
corresponding to a unified messaging subscriber voice mail inbox, enabling the unified messaging 
subscriber to use the unified messaging system for retrieval of the audio file as a stored voice 
message. 

5 One aspect of the present invention provides a method in a user computer for sending a voice 

message. The method includes recording a voice message based on encoding parameters recognized 
by a voice messaging system, and storing the voice message within a data file having a selectable 
Multipurpose Internet Mail Extension (MIME) type recognizable by the voice messaging system as 
a voice message. The method also includes outputting the data file using a prescribed messaging 
1 0 protocol for transfer to a destination voice mailbox accessible by the voice messaging system for a 
corresponding voice messaging subscriber. Storing the voice message within a data file having a 
* ;t selectable MIME type recognizable by the voice messaging system as a voice message enables the 
"■4 data file to be recognized as a voice message by the voice messaging system, even if the data file is 
l* sent to a destination voice mailbox without use of a messaging session control by the voice 

messaging system. Hence, a user can record a voice message locally using his or her user computer, 
f ') and forward the voice message using a prescribed messaging protocol, such as SMTP, to enable any 
I : , voice messaging subscriber to retrieve the message as a voice mail message. 
¥ Vs Another aspect of the present invention provides a user computer. The user computer 

i i 

f-;j includes a recorder configured for recording a voice message input by a user according to selected 

I s 20 encoding parameters recognized by a voice messaging system, and storing the voice message as a 
data file having a selectable MIME type recognizable by the voice messaging system as a voice 
message. The user computer also includes an e-mail client configured for sending the data file to 
a destination voice mailbox, using a prescribed messaging protocol, enabling access by the voice 
messaging system for a corresponding voice messaging subscriber. 
25 Additional advantages and novel features of the invention will be set forth in part in the 

description which follows and in part will become apparent to those skilled in the art upon 
examination of the following or may be learned by practice of the invention. The advantages of the 
present invention may be realized and attained by means of instrumentalities and combinations 
particularly pointed out in the appended claims. 



95-454 



WGM 3480 



BRIEF DESCRIPTION OF THE DRAWINGS 

Reference is made to the attached drawings, wherein elements having the same reference 
5 numeral designations represent like elements throughout and wherein: 

Figure 1 is a block diagram illustrating an system enabling deployment of a unified 
messaging system, capable of executing voice enabled web applications, according to an 
embodiment of the present invention. 

Figure 2 is a diagram illustrating the user computer of Figure 1, configured for locally 
10 generating a voice message to be sent to a destination voice mailbox for retrieval by the unified 

messaging system of Figure 1 according to an embodiment of the present invention. 
£■3 Figure 3 is a diagram illustrating the method of locally generating and sending a voice 

y 

%j message to a destination voice mailbox for retrieval by a unified messaging system according to an 
J; embodiment of the present invention. 

ri BEST MODE FOR CARRYING OUT THE INVENTION 

l. K The disclosed embodiment is directed to utilizing an executable plug-in resource within a 

computer (e.g. , a personal computer), enabling a user of the computer to encode a voice message into 
a data file and send the data file via a prescribed e-mail protocol such as SMTP. Moreover, the e- 

"fc-ilO mail client is configured for sending the data file containing the voice message with a selected 
attachment type identifier that enables a unified communication system (or at least a voice 
messaging system) to recognize the data file as containing an encoded voice messaging. Hence, a 
user computer can be utilized for creating and sending a voice message to a voice messaging 
subscriber, without the necessity for the sender to interact with the unified messaging system in order 

25 to leave the message. 

A description will first be given of the unified messaging architecture for use in storage and 
retrieval of unified messages including voice messages, followed by a detailed description of the 
arrangement for utilizing an executable plug-in resource enabling a user computer to record and 
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output a voice message to a destination voice mailbox accessible by a unified messaging system for 
a messaging subscriber. 

Figure 1 is a block diagram illustrating an architecture that provides unified voice messaging 
services and data services via an IP network using browser audio control according to an 
embodiment of the present invention, reproduced from Figure 3 of the above-incorporated 
application 09/480,485. The clients 42a and 42b, referred to herein as "fat clients" and "thin 
clients", respectively, have the distinct advantage that they can initiate requests using IP protocol 
to any connected web server 64 to execute part or most of the applications 44 on behalf of the 
clients. An example of a fat client 42a is an e-mail application on a PC that knows how to run the 
application 44 and knows how to run the IP protocols to communicate directly with the messaging 
server via the packet switched network 50. An example of a thin client 42b is a PC that has a web 
browser; in this case, the web browser 56 can use IP protocols such as HTTP to receive and display 
web pages generated according to hypertext markup language (HTML) from server locations based 
on uniform resource locators (URLs) input by the user of the PC. 

As shown in Figure 1, each of the clients (tiny clients, skinny clients, thin clients and fat 
clients) are able to communicate via a single, unified architecture 60 that enables voice 
communications services between different clients, regardless of whether the client actually has 
browser capabilities. Hence, the fat client 42a and the thin client 42b are able to execute voice 
enabled web applications without any hardware modification or any modification to the actual 
browser; rather, the browsers 56 in the clients 42a and 42b merely are provided with an executable 
voice resource configured for providing browser audio control, described below. 

The user devices 1 8a, 1 8b, and 1 8c, illustrated as a cordless telephone 1 8a, a fax machine 1 8b 
having an attached telephone, and an analog telephone 1 8c, are referred to herein as "skinny clients", 
defined as devices that are able to interface with a user to provide voice and/or data services (e.g., 
via a modem) but cannot perform any control of the associated access subnetwork. 

The wireless user devices 1 8d, 1 8e, and 1 8f, illustrated as a cellular telephone (e.g., AMPS, 
TDMA, or CDMA) 1 8d, a handheld computing device (e.g., a 3-Com Palm Computing or Windows 
CE-based handheld device) 18e, and a pager 18f, are referred to as tiny clients. "Tiny clients" are 
distinguishable from skinny clients in that the tiny clients tend to have even less functionality in 
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providing input and output interaction with a user, rely exclusively on the executable application in 
an access subnetwork to initiate communications; in addition, tiny clients may not be able to send 
or receive audio signals such as voice signals at all. 

Hence, the skinny clients 1 8a, 1 8b, and 1 8c and the tiny clients 1 8d, 1 8e, and 1 8f access the 
unified voice messaging services in the unified network 60 via a proxy browser 62, configured for 
providing an IP and HTTP interface for the skinny clients and the tiny clients. In particular, 
browsers operate by interpreting tags within a web page supplied via an HTTP connection, and 
presenting to a user media content information (e.g., text, graphics, streaming video, sound, etc.) 
based on the browser capabilities; if a browser is unable to interpret a tag, for example because the 
browser does not have the appropriate executable plug-in resource, then the browser typically will 
ignore the unknown tag. Hence, the proxy browser 62 can provide to each of the skinny clients and 
tiny clients the appropriate media content based on the capabilities of the corresponding client, such 
that the cordless telephone 18a and telephone 18c would receive analog audio signals played by the 
proxy browser 62 and no text information (unless a display is available); the fax machine 18b and 
pager 1 8f would only receive data/text information, and the cellular telephone 1 8d and the handheld 
computing device 1 8e would receive both voice and data information. Hence, the proxy browser 62 
interfaces between the IP network and the respective local access devices for the skinny clients and 
the tiny clients to provide access to the unified messaging network 60. 

The proxy browser 62 and the web browsers 56 within the fat client 42a and the thin client 
42b execute voice enabled web applications by sending data and requests to a web server 64, and 
receiving hypertext markup language (HTML) web pages from the web server 64, according to 
hypertext transport protocol (HTTP). The web server 64 serves as an interface between the browsers 
and an application server 66 that provides an executable runtime environment for XML voice 
applications. The application server 66, in response to receiving a request from the web server 64, 
may either supply the requested information in the form of an HTML page having XML tags for 
audio control by a voice resource within the browser, or may perform processing and return a 
calculated value to enable the browser 56 or 62 to perform additional processing. 

The application server 66 accesses selected stored XML application pages (i.e., XML pages 
that define an application) and in response generate new HTML pages having XML tags during 
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runtime and supply the generated HTML pages having XML tags to the web server 64. Since 
multiple transactions may need to occur between the browser 56 or 62 and the application server 66, 
the application server 66 is configured for storing for each existing user session a data record, 
referred to as a "brownie", that identifies the state of the existing user session; hence, the application 
5 server 66 can instantiate a procedure, return the necessary data, and terminate the procedure without 
the necessity of maintaining the instance running throughout the entire user session. 

Hence, the application server 66 executes voice application operations from a stored XML 
document based on a transient application state, where the application server 66 terminates the 
application instance after outputting the generated XML media information to the browser 1 8 or 42. 
10 Additional details describing the application server 66 are in the above- incorporated application 
09/480,485. 

£3 Figure 2 is a block diagram illustrating in further detail the user computer (e.g., thin client) 

I '\ 42 configured for sending a voice message for a voice messaging subscriber 18c according to an 
* ! ! embodiment of the present invention. As described above, the user computer 42 includes a browser 
iJ5 56 and an XML parser 70 configured for parsing XML tags within a received HTML page during 
L;f messaging sessions with the application server 66. However, instances may arise where a user of 
e the computer 42 may prefer to leave a voice message without initiating a messaging session with the 

II application server 66, for example if the user computer 42 (e.g., PC laptop) is mobile while the user 
* J is traveling; in such a case, the user may prefer are merely to send and receive e-mail messages. 
tgO According to the disclosed embodiment, the user computer 42 includes a voice message 

recorder plug-in 72 as a separate executable resource. The voice message recorder plug-in 72, 
instantiated by the browser 56, is configured for recording a voice message received via a 
microphone 80 according to encoding protocols utilized by voice messaging systems 100, for 
example within the application server 66. For example, voice messaging systems such as voice over 
25 IP based messaging systems utilize recognized 8kHz, mu-law encoding protocols such as G.71 1, 
G.729, and GSM. In contrast, conventional PC-based recording systems utilize different encoding 
formats (e.g., mu-law at 64kbps) for generation of .wav files. Hence, the voice message recorder 
plug-in 72 ensures that a voice message is encoded using a protocol compatible with the voice 
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messaging system 100, enabling playback of the encoded voice message by the voice messaging 
system 100. 

In addition, the voice message recorder plug-in 72, and/or the browser 56, are configured for 
selecting a MIME type that identifies the encoding of the voice message, and generating a data file 
5 76 having the encoded voice message and the selected MIME type. The generated data file 76 is 
stored on a tangible medium 78, for example a hard disk, enabling the e-mail client 74 to output the 
data file 76 to a destination voice mailbox 122a of an IMAP-based subscriber message store 120 
using IMAP or SMTP protocol. Hence, storage of the data file 76 within the voice mailbox 122a 
enables the voice messaging system 1 00 to properly identify the data file 76 as a voice mail message, 
10 as opposed to an e-mail attachment. 

Figure 3 is a diagram illustrating the method of sending a voice message to a subscriber 

[3 message store using a user computer, according to an embodiment of the present invention. The 

% -J 

vj steps described in Figure 3 can be implemented as executable code stored on a computer readable 
. ^ medium (e.g., a hard disk drive, a floppy drive, a random access memory, a read only memory, an 
v|5 EPROM, a compact disc, etc.). 

f n The method begins in step 200, where the user selects to record a voice message, for example 

l tz by selecting a command hyperlink in an HTML page displayed on the browser 56. The HTML page 
fr'ib may be stored locally within the computer 42, or may be received over the Internet. In response to 
the user selecting to record a voice message, the browser 56 instantiates (i.e., begins execution of) 
Q0 the voice messaging recorder plug-in 72 in step 202. The voice messaging recorder plug-in 72 
selects in step 204 a voice messaging system encoding, for example G.711, G.729^or GSM, for 
example based on a prescribed setting or based on determining the encoding of a destination 
subscriber's messaging system. At a minimum, the voice messaging recorder plug-in 72 selects in 
step 204 one of the messaging system encoding protocols based on default settings. 
25 The voice messaging recorder plug-in 72 begins the recording process in step 206, for 

example in response to the user pressing a "begin record" command button: the voice messaging 
recorder plug-in 72 encodes the speech signals received from the microphone 80 based on the voice 
messaging system encoding selected in step 204, and stores the encoded voice message on the hard 
disk 78. 



95-454 



10 



WGM 3480 



The voice messaging recorder plug-in 72 selects in step 208 a Multipurpose Internet Mail 
Extension (MIME) type based on the selected encoding, and recognizable by the voice messaging 
system 100. For example, the voice messaging system 100 may use the MIME type extensions 
".711", ".729", and ".GSM" for identification of G.711, G.729 and GSM encoding, respectively. 
The voice messaging recorder plug-in 72 creates in step 210 a data file 76 that includes the stored 
encoded voice message and the selected MIME type, enabling the voice messaging system 100 to 
decode and playback the encoded voice message. 

The voice message recorder plug-in 72 includes a review/playback option, enabling the user 
to listen to the recorded voice message before sending the data file 76 to the message store 120. If 
in step 212 the user selects playback of the message, the voice message recorder plug-in 72 plays 
back the recorded voice message in step 214 over the speaker 82. Once the user is satisfied with the 
message, the user can then cause the e-mail client 74 to output in step 216 a message containing the 
data file 76 for delivery via SMTP or IMAP to the destination voice mailbox 122a of the destination 
subscriber. For example, the message store 120 may have its own host domain address (e.g., 
"messagestore.net") with separate address fields identifying the subscriber ("j smith") and the 
message type (e.g., "voice"), such that the e-mail address "jsmith@voice.messagestore.net" would 
be used by the e-mail client 74 to deposit the voice message recorded in the data file 76 into the 
voice mailbox 122a for the messaging subscriber "j smith" within the IMAP message store 120 
having the host domain address "messagestore.net". 

According to the disclosed embodiment, voice messages can be locally generated using a 
personal computer, and sent via IMAP or SMTP protocol to a message store for a unified messaging 
system, eliminating the necessity for interactive sessions with the application server 66 to leave a 
voice message. Moreover, the generation of the data file 76 using an encoding protocol recognized 
by the voice messaging system 100, and including a MIME type that identifies the encoding format, 
enables the voice messaging system 100 to play back the stored voice message for the messaging 
subscriber, as opposed to merely interpreting the data file as an attachment to an e-mail message. 

While this invention has been described in connection with what is presently considered to 
be the most practical and preferred embodiment, it is to be understood that the invention is not 
limited to the disclosed embodiments, but, on the contrary, is intended to cover various 
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modifications and equivalent arrangements included within the spirit and scope of the appended 
claims. 
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